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The  Variance  of  Rasch  Ability  Estimates  from 
Partially-Known  Item  Parameters 


Abstract 

A  closed-form  approximation  is  given  for  the  variance  of  examinee  proficiency 
estimates  in  the  Rasch  model  for  dichotomous  items,  under  the  condition  that  only 
estimates,  rather  than  true  values,  of  item  difficulty  parameters  are  available.  The  term  that 
must  be  added  to  the  usual  response-sampling  variance  is  inversely  proportional  to  both  the 
number  of  examinees  in  the  item  calibration  sample  and  the  length  of  the  test.  Illustrative 
numerical  values  suggest  that  the  impact  of  uncertainty  about  Rasch  item  parameters  on 
subsequent  estimates  of  examinee  proficiencies  is  less  than  has  been  observed  in  the  2-  and 
3-parameter  logistic  IRT  models. 

Key  words:  Cohen’s  approximation,  Rasch  model,  variance  components 
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Introduction 

It  is  common  practice  in  applications  of  item  response  theory  (IRT)  to  estimate  item 
parameters  from  a  calibration  sample  of  examinees,  then  use  these  estimates  as  if  they  were 
known  true  parameters  when  estimating  the  proficiency  parameters  of  these  and  subsequent 
examinees.  Tsutakawa  and  his  colleagues  have  pointed  out  that  ignoring  the  uncertainty 
about  item  parameters  leads  to  inferential  errors,  and  offered  a  Taylor  series  approximation 
to  incorporate  this  uncertainty  into  proficiency  estimates  and  statements  about  their 
precision.  Results  for  the  two-parameter  logistic  IRT  model  appear  in  Tsutakawa  and 
Soltys  (1988)  and  for  the  three-parameter  logistic  model  appear  in  Tsutakawa  and  Johnson 
(1990).  (Also  see  Lewis,  1985,  for  an  alternative  approach  to  the  problem,  and  Mislevy, 
Sheehan,  &  Wingersky,  in  press,  for  the  application  of  these  ideas  to  test  equating.) 

Wright  and  Panchapekesan  (1969)  present  without  derivation  a  closed-form  approximation 
for  the  variance  of  examinee  proficiency  estimates  under  the  Rasch  model  for  dichotomous 
items  (Rasch,  1960/1980).  Utilizing  a  series  of  computing  approximations  and  simplifying 
assumptions,  the  present  paper  gives  a  somewhat  simpler  approximation.  Neither 
numerical  accuracy  nor  practical  application  is  the  point  of  this  presentation— the 
aforementioned  alternatives  are  preferable  in  this  regard.  Rather,  by  giving  an 
approximation  with  fewer  “ moving  parts,"  the  objective  is  to  aid  intuition  into  the  sources, 
the  structures,  and  the  consequences  of  uncertainty. 

The  Rasch  Model 

The  Rasch  model  for  dichotomous  items  gives  the  probability  of  a  correct  response 
to  Item  j  from  an  examinee  with  proficiency  0  as 

Pj(6)  ■  ...»P(9±L , 

l+exp(0-bj) 


(1) 
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where  bj  is  the  difficulty  parameter  of  Item  j.  Letting  xj  denote  the  response  to  Item  j,  1  for 
correct  and  0  for  incorrect,  the  assumption  of  local  independence  gives  the  conditional 
probability  of  the  response  vector  x=(xi,...,xl)  on  an  L-item  test  as 

P(xie,b)  =  nPj(0)Xj[l-Pj(8)]1^, 

i=i  (2) 

where  b=(bi,...,bL). 

Given  item  difficulty  parameters  and  a  realization  of  x,  (2)  can  be  interpreted  as  a 
likelihood  function  for  0.  Unless  all  the  responses  are  correct  or  all  are  incorrect,  it  attains 

xv 

its  maximum  at  a  unique  point,  the  maximum  likelihood  estimate  (MLE)  0.  The  negative 
reciprocal  of  its  second  derivative  at  this  point  approximates  the  sampling  variance  of  0,  or 

/N 

Var(0l0,b).  Given  response  vectors  from  a  calibration  sample  of  N  examinees,  the  product 
of  expressions  like  (2)  serves  similarly  as  a  basis  for  the  estimation  of  b  and  the  sampling 
variance  of  the  resulting  estimate  b. 

Cohen’s  Approximations 

<V  XV 

xv 

Cohen  (1979)  gives  closed  form  approximations  for  8,  Var(010,b),  b,  and 
Var(blb)  for  long  tests  when  both  8  and  b  are  normally  distributed,  in  the  samples  of 
examinees  and  items  respectively.  Under  these  circumstances,  item  difficulty  parameters 
can  be  approximated  by  rescaling  the  logits,  or  log-odds,  of  item  percents-correct  in  the 
calibration  sample,  and  examinees’  proficiencies  can  be  approximated  by  rescaling  logits  of 
their  total  scores  by  functions  of  item  parameters.  Adapting  Wright’s  (1977)  presentation, 
we  begin  with  a  calibration  data  set  from  which  zero  and  perfect  scoring  examinees  and 
items  with  all  or  no  correct  responses  have  been  excised,  then  calculate  the  following 
quantities: 
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Pj 


nr 


tj  =  In 


L 

T  =  ^  (tj-t.)2/(L-l) 


j=i 


y. 


L-l 

=  X  nry^/N 


r=l 


L-l 

Y  =  £nr(yr-y.)2/(N-l) 


r=l 


l+Y/2.89  V/2 
l-TY/8.35* 


the  proportion  of  the  calibration  sample  that 
answered  Item  j  correctly,  for  j=l,...,L, 

the  number  of  examinees  with  a  total  score  of  r,  for 
r=l,...,L-l, 

the  log  ratio  of  wrong  to  right  answers  on  Item  j, 

the  mean  of  tj  over  L  items, 

the  variance  of  tj  over  L  items, 

the  log  ratio  of  right  to  wrong  answers  for  score  r, 

the  mean  of  yr  over  N  examinees, 

the  variance  of  yr  over  N  examinees,  and 

an  expansion  factor,  in  which  1.7  is  used  to  match 
the  logistic  and  normal  distributions,  and  2.89=1. 72 
and  8.35=1.74. 


Then,  from  Cohen  (1979),  item  parameters  can  be  approximated  as  follows: 


bj  =  W  (tj-t) 


(3) 


and 
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Varfbjlbj)  -  jL 


_w_  1  =  Cj 

Pjd-Pj))  N  ’ 


where  Cj=W2/[Pj(  1-Pj)].  The  sampling  covariances  among  the  parameters  of  different 
items  tend  toward  zero  as  L  increases,  as  long  as  the  items  are  not  too  dissimilar  (Mislevy, 
1981,  shows  that  the  error  correlations  among  equivalent  items  are  -1/(L-1)).  We  shall 
therefore  approximate  the  L-by-L  covariance  matrix  of  sampling  errors  among  item 
parameters  as  simply 

Var(blb)  -  diag(§-, . 


If  item  parameters  are  known,  examinee  proficiencies  can  be  similarly  approximated 
by  rescaling  logits  of  their  total  scores.  Define  three  additional  quantities: 

L 

b  =  X  VL 

j=  i  the  mean  of  bj  over  L  items, 

L 

U  =  X  tbj-b  )2/(L-l) 

j= i  the  variance  of  bj  over  L  items,  and 

X  =  ( 1  +U/2.89)1/2  an  expansion  factor. 

Then,  for  a  total  score  of  r, 

S-b.  +  Xta(£}-b  +X.„(1Ey, 

where  pr  s  r/L,  and 


(5) 


(6) 
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Estimating  Ability  with  Item  Parameter  Estimates 
When  b  is  known,  (5)  gives  a  proficiency  estimate  from  x,  and  (6),  evaluated  with 

A 

the  true  value  of  9,  gives  its  sampling  variance.  What  is  the  sampling  variance  of  0  when 


(5)  is  evaluated  with  b  rather  than  b?  In  this  presentation,  this  amounts  to  using  item 
parameter  estimates  rather  than  true  parameter  values  to  calculate  b.  and  X.  The  setup 
corresponds  to  a  two-stage  experiment: 

Stage  1 :  A  sample  of  N  examinees  is  drawn  from  a  normal  population.  They 

respond  to  the  L  items  in  the  test.  Their  responses  are  used  to  calculate  b 
via  (3). 

Stage  2:  A  new  examinee  is  administered  the  test  and  the  test  score  r  is  observed.  A 

proficiency  estimate  is  calculated  using  (5)  with  b.  We  can  write  this 

A 

estimate  as  0(r,b)  to  emphasize  that  it  is  a  function  of  two  statistics — which, 
it  will  be  noted,  are  independent,  given  b  and  0. 

-A 

The  variance  of  0  in  this  setting  can  be  decomposed  into  two  terms: 


r 


Var(0l0)  =  E£lVar(0l0,b)]  +  Var~|E(0l0 


>,b). 


(7) 


The  first  term  on  the  right  of  (7)  is  the  expectation  of  (6)  as  evaluated  with  b,  over 
the  distribution  of  b  given  b.  It  depends  on  b  only  through  X2,  or  l+U/2.89,  where  U  is 
the  variance  of  the  true  item  parameters.  The  expected  variance  of  the  item  parameter 
estimates  is  the  variance  of  the  item  parameters  themselves  plus  the  average  estimation  error 
variance,  C/N=(ICj/L)/N.  Thus, 


1  <I+(U+C,/N)/2.89\ 

L\  Pr(l-Pr)  ) 
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L  \PrO-pr) '  LN  \2.89p; 


1 _ 

>r(l'Pr) 


(B) 


This  is  the  sum  of  the  error  variance  for  0  with  known  item  parameters  and  a  term 

depending  on  their  error  variance  that  is  inversely  proportional  to  both  L  and  N. 

/\ 

The  second  term  in  (7)  concerns  the  variation  in  0  associated  with  the  expected  test 
score  r  for  the  true  0,  as  induced  by  variation  in  b.  This  term  can  be  approximated  by  the 
delta  method  as  follows: 


Var; 


~  <*«  1  30  30 

E'0l0,b)J  =  —  Varfblb)  — 

3b'  3b 


L  (3ft 

-2  i"  }  Vartbjlbj) 

L 

=  1 
j=l 


lW 

_\3bj 


[by  (4)] 


\2  ~ 

[b~+ *'"&)] 

Varfbjlbj) 

‘III 


(bj-b)ln[-2!- 
1  |  J  U-Pr 


2.89  LX 


£l 

N 


Approximating  all  Cjs  by  their  average,  say  C.,  leads  to  the  following  simplification: 


Varr 


E(0l0,b)]  - 

LN 


U  In 


1  +- 


_Pi_\l2 
l-Pr 


8.35  X2 

Substituting  (8)  and  (9)  back  into  (7)  yields  the  final  approximation: 


1  x2 

+  _c_ 

\Pr(l-Pr) 

LN 

1 


"Map 


\l  +  2.89pr(l-pr)  8.35  X2 


(9) 
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*  Var(0IG,b)  + 


LN 


U  In 


1  + 


Pr  \|2 


1-Pr 


2.89 pr (l-pr)  8.35  x2 


(10) 


Thus  the  sampling  variance  of  0  with  item  parameter  estimates  can  be  approximated  as  the 
sum  of  its  variance  with  true  item  parameters  and  a  correction  term.  The  following 
observations  can  be  made  about  the  correction  term: 

1 .  It  is  always  positive. 

2.  It  is  inversely  proportional  to  test  length  (L). 

3.  It  is  inversely  proportional  to  the  size  of  the  examinee  calibration  sample  (N). 

4.  It  is  directly  proportional  to  C.  Since 

( l+Y/2.89  \ 
c  _ ' l-TY/8.35/ 

v-*i  -  -  ) 

Pj(l-Pj) 

where  Y  is  the  variance  of  the  logits  of  item  percents-correct  and  Pj  is  the  percent- 
correct  for  Item  j  in  the  calibration  sample,  the  impact  of  the  uncertainty  about  item 
parameters  is  greater  when... 

a.  the  items  are  more  dispersed,  so  that  Y  departs  from  zero,  or 

b .  items  are  farther  from  50-percent  correct,  so  that  Pj(  1  -Pj)  terms  fall  farther 
from  the  maximum  value  of  .25. 

5 .  Values  of  0  for  which  expected  proportions  of  correct  response  are  near  50-percent 
are  less  affected  by  uncertainty  about  item  parameters  than  more  extreme  values  of 
0.  This  follows  from  the  second  and  third  terms  inside  the  brackets  in  (10):  As  pr 
approaches  .5,  the  second  term  approaches  its  minimum  value  of  4/2.89,  and, 
because  the  logit  of  .5  is  zero,  the  third  term  approaches  zero. 
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Illustrative  Numerical  Values 

To  provide  a  feel  for  the  relative  contributions  of  sources  of  uncertainty  this  section 
evaluates  the  preceding  formulae  with  some  illustrative  values.  Standard  normal 
distributions  are  assumed  for  0  and  b  in  the  item  calibration  sample,  implying  the  following 
values  for  true  parameter  values: 

t.  =  y.  =  b.  =  0 
T  =  Y  =  .743 
X  =  W  =  1.160 
U  =  1  . 

/N 

Equation  (10)  is  used  to  approximate  0  sampling  variances,  for  0  =  0  and  2,  for  test 
lengths  of  10,  20, 40,  80,  and  160  items,  after  item  calibration  with  examinee  samples  of 
50,  100,  250,  500,  1000,  2500,  and  10000.  For  C.,  we  employ  a  representative  value, 
namely  that  for  an  item  one  standard  deviation  from  the  mean.  For  such  an  item,  P  is  about 
.7,  in  which  case 

C.  =  W2/(.7  x  .3)  =  6.40  . 

The  values  of  pr  that  correspond  to  0  =  0  and  2  are  .50  and  .85. 

Table  1  gives  results  for  0  =  0,  in  terms  of  approximate  sampling  variances  and 
proportional  increases  in  sampling  variance  over  those  based  on  known  item  parameters. 
The  proportional  increases  in  standard  errors  are  the  square  roots  of  the  values  in  the 
rightmost  column.  Table  2  gives  similar  results  for  0  =  2. 

[  Tables  1  and  2  about  here  ] 

The  most  striking  feature  of  these  results  is  how  small  the  corrections  are.  Even 
with  a  calibration  sample  of  only  50  examinees,  estimation  error  variances  for  subsequent  0 
estimates  increase  by  only  about  5-percent.  This  contrasts  with  the  increases  of  up  to  30- 
percent  Tsutakawa  and  Soltys  (1988)  observed  in  posterior  variances  for  0  with  a 
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calibration  sample  of  100  under  the  2-parameter  logistic  model.  Tsutakawa  and  Johnson’s 
(1990)  results  for  the  3-parameter  logistic  were  even  more  extreme,  with  increases  in 
posterior  variances  more  than  doubling  at  higher  levels  of  proficiency  with  a  calibration 
sample  of  400. 


Conclusion 

Cohen’s  (1979)  closed-form  approximations  for  the  parameters  in  the  Rasch  model 
support  a  closed-form  approximation  for  the  variance  of  these  examinee  proficiency 
estimates  when  they  are  calculated  with  item  parameter  estimates  rather  than  true  item 
parameter  values.  The  approximation  is  the  sum  of  the  sampling  variance  with  known  item 
parameters  and  a  correction  term.  The  correction  term  is  inversely  proportional  to  both  test 
length  and  the  size  of  the  examinee  item-calibration  sample.  Illustrative  numerical  values 
suggests  the  additional  variance  is  quite  small,  yielding  increases  in  standard  errors  of  less 
than  5-percent  even  with  calibration  samples  of  only  50  examinees. 
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Table  1 


Approximate  Error  Variances  at  0=0 


N 

L 

Var(0l0,b) 

Var(0l0,b) 

10 

20 

40 

80 

160 

50 

0.5689 

0.2845 

0.1422 

0.0711 

0.0356 

1.0567 

100 

0.5537 

0.2768 

0.1384 

0.0692 

0.0346 

1.0283 

250 

0.5445 

0.2723 

0.1361 

0.0681 

0.0340 

1.0113 

500 

0.5415 

0.2707 

0.1354 

0.0677 

0.0338 

1.0057 

1000 

0.5399 

0.2700 

0.1350 

0.0675 

0.0337 

1.0028 

2500 

0.5390 

0.2695 

0.1348 

0.0674 

0.0337 

1.0011 

10000 

0.5386 

0.2693 

0.1346 

0.0673 

0.0337 

1.0003 

oo 

0.5384 

0.2692 

0.1346 

0.0673 

0.0337 

1.0000 

Partially  Known  Item  Parameters 
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Table  2 


Approximate  Error  Variances  at  0=2 


N 

L 

Var(0l0,b) 

Var(0l0,b) 

10 

20 

40 

80 

160 

50 

1.1066 

0.5533 

0.2767 

0.1383 

0.0692 

1.0483 

100 

1.0812 

0.5406 

0.2703 

0.1351 

0.0676 

1.0241 

250 

1.0659 

0.5329 

0.2665 

0.1332 

0.0666 

1.0097 

500 

1.0608 

0.5304 

0.2652 

0.1326 

0.0663 

1.0048 

1000 

1.0582 

0.5291 

0.2646 

0.1323 

0.0661 

1.0024 

2500 

1.0567 

0.5284 

0.2642 

0.1321 

0.0660 

1.0010 

10000 

1.0559 

0.5280 

0.2640 

0.1320 

0.0660 

1.0002 

oo 

1.0557 

0.5278 

0.2639 

0.1320 

0.0660 

1.0000 

STOVT.TCL  27  JAN  91 

FROM  ALL.ARIA,  MSURMNT 

Dr.  Terry  Ackerman 
Educational  Psychology 
J60C  Education  Bldg. 

University  of  Illinois 
Champaign,  IL  61801 

Or.  Terry  ABard 
Code  U42CS 
Office  of  Naval  Research 
800  N.  Quincy  St 
Arlington,  VA  22217-5000 

Dr.  Nancy  Alien 
Educational  Testing  Service 
Princeton,  NJ  08541 

Dr.  Gregory  Anrig 
Educational  Testing  Service 
Princeton.  NJ  08541 

Dr.  Phipps  Arabie 

Graduate  School  of  Management 

Rutgers  University 

92  New  Street 

Newer*  NJ  07102-1895 

Dr.  Isaac  L  Bcjar 
Law  School  Admissions 
Services 
Box  40 

Newtown,  PA  189400040 

Dr.  William  O.  Berry 
Director  of  Life  and 
Environmental  Somers 
AF05RJNU  Nt  Bldg.  410 
Bolling  AFB.  DC  20332-6448 

Dr.  Thomas  G.  Bever 
Department  of  Psychology 
University  of  Rochester 
River  Station 
Rochester.  NY  14627 

Dr.  Mcnucha  Birenhauo 
Educational  Testing 

Princeton,  NJ  08S41 

Dr.  Bruce  Btoaom 
Defense  Manpower  Dtu  Center 
99  Pacific  St 
Suita  155A 

Monterey.  CA  9390-3231 

Dr.  Gwyneth  Boodoo 
Educational  Testing  Service 
Princeton,  NJ  08541 

Dr.  Richard  L  Branch 
HO.  USMEPOOM/MEPCT 
2500  Green  Bay  Road 
North  Owes  go,  IL  60064 

Dr.  Robert  Brennan 
American  College  Testing 
Prepaa 
P.  a  Boa  168 
kjwa  City.  IA  52243 

Dr.  David  V.  Budaaoi 
Department  of  Piycbolog 
University  of  Haifa 
Mount  Camel.  Haifa  31999 
ISRAEL 

Dr.  Gregory  Candtfl 
CTB/MacMidafVMcGraW'Hil 
2500  Garden  Road 
Monterey,  CA  93940 

Dr.  Paid  R.  Oiatcfter 

Perceptronks 

1911  North  Ft  Myer  Dr. 

Suite  BOO 

Arin^on,  VA  22209 


Dr.  Susan  Chipman 
Cognitive  Science  Proyam 
Office  of  Naql  Reseat  eh 
800  North  Quincy  St 
Arlington.  VA  22217-5000 

Dr.  Raymond  E.  Christa! 

UES  LAMP  Science  Advisor 

AL/HRM7L 

Brooks  AFB,  TX  78235 

Dr.  Norman  Cliff 
Department  of  Psychology 
Untv.  of  So.  California 
Los  Angetea,  CA  90089-1061 

Director 

Life  Sciences,  Code  1142 
Office  of  Naval  Research 
Arlington,  VA  22217-5000 

Commanding  Officer 
Naval  Research  Laboratory 
Code  4827 

Washington,  DC  20375-5000 

Dr.  John  M.  ComweS 
Department  of  Psychology 
I/O  Psychology  Program 
TuUnc  University 
New  Orleans,  LA  70118 

Dr.  William  Crano 
Department  of  Psychology 
Teas  MM  University 
College  Station,  TX  77843 

Dr.  UndM  Curran 

Defense  Manpower  Data  Center 

Suite  400 

1600  Wilson  Blvd 

Roaslyn,  VA  22209 

Dr.  Timothy  Devey 
American  College  Testing  Program 
P.O.  Box  168 
Iowa  City,  IA  52243 

Dr.  Charles  E.  Davis 
Educational  Testing  Service 
Mail  Scop  22-T 
Princeton.  NJ  08541 

Dr.  Ralph  J.  DcAyaia 
Measurement.  Statistics. 

and  Evaluation 
Benjamin  Bldg.,  Rm.  1230F 
University  of  Maryland 
College  Part.  MD  20742 

Dr.  Sharon  Derry 
Florida  State  University 
Department  of  Psychology 
Tallahassee.  FL  32306 

Ho-Ki  Dong 

6  Corporate  Pi 
RM:  PYA-1K207 
P.O.  Box  1320 
Piscatawsy.  NJ  08855-D20 

Dr.  Nefl  Dorans 
Educational  Testing  Service 
Princeton.  NJ  08541 

Dr.  Friu  Drasgov 
University  of  Ifinois 
Department  of  Psychology 
603  E.  Darnel  Sc 
Champaign.  IL  61820 

Defense  Technical 
Information  Center 
Cameron  Station.  Bldg  5 
AJeandrta.  VA  22314 
(2  Copies) 


Dr.  Richard  Duran 
Graduate  School  of  Education 
University  of  California 
Santa  Bactma,  CA  93106 

Dr.  Susan  Embretson 
University  of  Kansas 
Psychology  Department 
426  Fraser 
Lawrence,  KS  66045 

Dr.  George  Engelhard.  Jr. 
Division  of  Educational  Studies 
Emory  University 
210  Fisbburne  Bldg. 

Atlanta,  GA  30322 

ERIC  Fac&ty-Acquisitiooa 
2440  Research  BtaL  Suite  550 
Rockville.  MD  20659-3238 

Dr.  Marshall  J.  Farr 
Farr-Sigbt  Co. 

2520  North  Vernon  Street 
Artmgtoo.  VA  22207 

Dr.  Leonard  Feldt 
Lindquist  Center 
for  Measurement 
University  of  Iowa 
Iowa  Cky.  LA  52242 

Dr.  Richard  L  Ferguson 
American  College  Testing 
P.O.  Box  168 
Iowa  City.  1A  52243 

Dr.  Gerhard  Fischer 
Uehiggasse  5 
A  1010  Vienna 
AUSTRIA 

Dr.  Myron  Fischt 
U-S.  Army  Headquarters 
DAPE-HR 
The  Pentagon 

Washington.  DC  203100300 

Mr.  Paul  Foley 

Navy  Personnel  RAD  Center 

San  Diego.  CA  92152-6800 

Chair,  Department  of 
Computer  Science 
George  Mason  University 
Fairfax.  VA  22030 

Dr.  Robert  D.  Gibbons 
University  of  IRinois  at  Chicago 
NPI  909 A.  M/C  913 
912  South  Wood  Street 
Chicago,  IL  60612 

Dr.  Janice  Gifford 
University  of  Massachusetts 
School  of  Education 
Amherst,  MA  02003 

Dr.  Robert  Glaser 
Learning  Research 

A  Development  Center 
University  of  Pittsburgh 
3939  O’Hara  Street 
Pittsburgh.  PA  15260 

Dr.  Susan  R.  Goldman 
Peabody  College.  Boa  45 
Vanderbilt  University 
Nashviie,  TN  37203 

Dr.  Timothy  Goldsmith 
Department  of  Psycbologr 
University  of  New  Mexico 
Albuquerque,  NM  87131 


01/27/92 


Or.  Joseph  McUchUn 

Dr.  Peter  J.  PasWey 

Dr.  Judy  Spray 

Navy  Personnel  Research 

Educational  Testing  Service 

ACT 

and  Prvriopmeot  Center 

Rosedate  Road 

P.O.  Box  168 

Code  14 

Princeton,  NJ  06541 

Iowa  Cay,  IA  522X3 

San  Diego,  CA  92152-6000 

Wayne  M.  Patience 

Dr.  Maltha  Stocking 

Alan  Mead 

American  Council  on  Education 

Educational  Toting  Service 

c/o  Dr.  Michael  Levine 

GED  Testing  Service,  Suite  20 

Princeton,  NJ  065X1 

Educational  Psychology 

One  Dupont  Gnde,  NW 

210  Education  Bldg. 

Washington,  DC  20036 

Dr.  Wifaa  Stout 

University  of  Illinois 

Univenicy  of  IHinoa 

Champaign.  IL  61801 

Dept  of  Adaiimtrativ*  Sciences 

Department  of  Stacktiei 

Code  54 

101  HIM  Hal 

Dr.  Timothy  Miller 

Naval  Postgraduate  School 

725  South  Wright  St 

ACT 

Monterey.  CA  93943- $026 

Oiarapitgn.  IL  61820 

P.  O.  Boot  168 

Iowa  Cky.  LA  52243 

Dr.  Peter  Piroili 

Dr.  Kikumi  Tatauoka 

School  of  Education 

Educational  Testing  Service 

Dr.  Robert  Mislevy 

University  of  California 

Mai  Stop  03-T 

Educational  Testing  Service 

Berkeley.  CA  94720 

Princeton  NJ  06S41 

Princeton.  NJ  06541 

Dr.  Mark  D-  Redcase 

Dr.  David  Thaaen 

Dr.  fvo  Molenar 

ACT 

Payebomethc  Laboratory 

Facukek  Sodale  Wetenschappen 

P.  O.  Box  168 

CB#  32m  Davie  Halt 

Rijksuniversftcit  Gromrgen 

Iowa  Gty.  IA  52243 

Univenity  of  North  Carolina 

Grote  Knmatraal  2/1 

Chapel  Hill.  NC  27599-3270 

9712  TS  Groningen 

Mr.  Steve  Retie 

The  NETHERLANDS 

Department  of  Psychology 

Mr.  Thomas  J.  Thomas 

Dr.  E  Muraki 

University  of  California 

Federal  Ezpreaa  Corporation 

Riverside,  CA  92521 

Human  Reaource  Development 

Educational  Testing  Service 

3035  Director  Roe.  Suite  SOI 

Rosedate  Road 

Mr.  Louis  Roossos 

Mcmpbit  TN  38131 

Princeton,  NJ  08541 

University  of  Illinois 

Department  of  Statistics 

Mr.  Gary  Thomamon 

Dr.  Ratna  Nandakumar 

101  niim  Had 

Univenity  of  IIKnota 

Educational  Studies 

725  South  Wright  Sc 

Educational  Pqrcbotogy 

Willard  Hall.  Room  213E 

Champaign,  IL  61820 

Champaign.  U.  61820 

University  of  Delaware 

Newark,  DE  19716 

Dr.  Donald  Rubin 

Dr.  Howard  Warner 

Statistics  Department 

Educational  Teating  Service 

Academic  Progs-  A  Research  Branch 

Science  Center,  Room  606 

Princeton  NJ  085X1 

Naval  Technical  Training  Command 

1  Oxford  Street 

Code  N4Z 

Harvard  University 

Elizabeth  Wald 

NAS  Memphis  (75) 

Cambridge.  MA  02138 

Office  of  Naval  Technology 

Millington,  TN  30654 

Code  227 

Dr.  Fumiko  Samepau 

800  North  Chancy  Street 

Dr.  W.  Alan  Nicewandet 

Department  of  Psychology 

Arlington  VA  22217-5000 

University  of  Oklahoma 

University  of  Tennessee 

Department  of  Psychology 

310B  Austin  Pesy  Bldg 

Dr.  Michad  T.  Waller 

Norman.  OK  73071 

Knoxville,  TN  379664900 

Univcriicy  of 

Head,  Personnel  Systems  Department 

Dr.  Maty  Scfaratx 

Wnconam-Mihvaukee 
Educational  Paychology  Dept 

NPRDC  (Code  12) 

4100  Parfctide 

Bat  413 

San  Diego.  CA  92152-6600 

Carlsbad.  CA  92006 

Milwaukee.  W]  53201 

Director 

Mr.  Robot  Swwna 

Dr.  Ming- Mrs  Wang 

Training  Systems  Department 

N218  Eliott  Hafi 

Educational  Teating  Service 

NPRDC  (Code  14) 

Department  of  Psychology 

Mai  Stop  03-T 

San  Diego.  CA  921524600 

University  of  Minnesota 

Princeton  N3  06541 

library,  NPRDC 

Minneapolis,  MN  554554344 

Dr.  Tbomaa  A.  Warm 

Code  041 

Dr.  Valerie  L  Shafcn 

FAA  Academy 

San  Diego,  CA  921524600 

Department  of  Industrial 

P.O.  Box  23882 

Engineering 

Oklahoma  Gty.  OK  73125 

librarian 

State  University  of  New  York 

Naval  Center  for  Apptied  Research 

342  Lawrence  D.  Beg  Ha M 

Dr.  David  J.  Warn 

in  Artificial  Incetiigence 

Buffalo.  NY  14260 

N660  EJhou  HaO 

Navel  Research  Laboratory 

Univenity  of  Minnesota 

Code  5510 

Mr.  Richard  J.  Shavelaoo 

75  &  River  Roed 

Washington.  DC  20375-5000 

Graduate  School  of  Education 

Mmneapokk  MN  534554344 

Offies  of  Nati  Research. 

University  of  California 

Santa  Barbara.  CA  93106 

Dr.  Douglae  Wetzel 

Code  1142CS 

Code  15 

600  N.  Quincy  Street 

Mt  Kathleen  Sheehan 

Navy  Personnel  RAD  Center 

Ackn^on.  VA  22217-5000 

Educational  Testing  Service 

San  Diego,  CA  92152-6800 

(6  Copies) 

Princeton.  NJ  06541 

Special  Assistant  for  Research 

Dr.  Kasuo  Shigematu 

German  Military 

Repnaentative 

Management 

7-9-24  Kiigcnume-Kiipn 

Chief  of  NmI  Pcnornd  (PERSOUT) 

Fujmea  2S1 

KodnerStr.  262 

DiHWl  of  the  Navy 

JAPAN 

D-5000  Kodn  90 

WatbingMn  DC  OTSO-MO* 

WEST  GERMANY 

Or.  Judkh  Oniwu 

Dr.  Randal  Shumaker 

Naval  Research  Laboratory 

Mai  Slop  2391 

Code  5500 

NASA  Am  Reaaardi  Center 

4555  Overtook  Avenue.  S.W 

Moffett  Reid,  CA  9X035 

Wasbinfon.  DC  20375-5000 

Dr.  Sherrie  Gott 

Dr.  Kumar  Joag-dev 

Richard  Lanterman 

afhrumomj 

University  of  Illinois 

Commandant  (G-PWP) 

Brooks  AFB,  TX  78235-5601 

Department  of  Statistics 

US  Coast  Guard 

101  IBini  Hafl 

2100  Second  St,  SW 

Dr.  Ben  Green 

725  South  Wright  Street 

Washington,  DC  205934)001 

John*  Hopkins  University 

Champaign,  IL  61820 

Department  of  Psychology 

Dr.  Michad  Levine 

Charles  A  34th  Street 

Professor  Douglas  H.  Jones 

Educational  Psychology 

Baltimore,  MD  21218 

Graduate  School  of  Management 

210  Education  Bldg 

Rutgers,  The  State  University 

1310  South  Sixth  Street 

Prof.  Edward  Haertd 

of  New  Jersey 

University  of  IL  at 

School  of  Education 

Newark.  NJ  07102 

U  rbana-Champaign 

Stanford  University 

Champaign,  IL  61820^990 

Stanford.  CA  94305-3066 

Dr.  Brian  Junker 

Camcgie-Mdion  University 

Dr.  Charies  Lewis 

Dr.  Ronald  K.  HamMeton 

Department  of  Statistics 

Educational  Testing  Service 

University  of  Mauacbuscua 

Laboratory  of  Psychometric 

Pittsburgh.  PA  15213 

Princeton.  NJ  06541-0001 

and  Evaluative  Research 

Dr.  Mated  Just 

Mr.  Hsin-bung  Li 

Hitts  South,  Room  152 

Camegje-Meikxi  University 

University  of  l&nots 

Amherst  MA  01003 

Department  of  Psychology 

Department  of  Statistic* 

Schenicy  Part 

101  Mini  Hal 

Dr.  Defrvyn  Harniach 

Pittsburgh,  PA  15213 

725  South  Wright  Sc 

University  of  Ulmoia 

Champaign.  IL  61820 

51  Gerry  Drive 

Dr.  J.  L  Kaiwi 

Champaign,  1L  61820 

Code  442/JK 

Library 

Naval  Ocean  tystems  Center 

Naval  Training  Systems  Center 

Dr.  Patrick  R.  Harrison 

San  Diego,  CA  92152-5000 

12350  Research  Partway 

Computer  Science  Department 

Orlando.  FL  32826-3224 

U3L  Naval  Academy 

Dr.  Michad  Kaplan 

Annapolis.  MD  21402-5002 

Office  of  Basic  Research 

Dr.  Marcia  G  Linn 

US.  Army  Research  Institute 

Graduate  School 

Ms.  Rebecca  Hettcr 

5001  Eisenhower  Avenue 

of  Education,  EM  ST 

Navy  Personnel  RAD  Center 

Alexandria.  VA  22333-5600 

Totman  Hafl 

Code  13 

University  of  California 

San  Diego.  CA  92152-6800 

Dr.  Jeremy  Kilpatrick 

Department  of 

Berkeley.  CA  94720 

Dr.  Thomas  M.  Hirsch 

Mathematics  Education 

Dr.  Robert  L.  Lino 

ACT 

IQS  Aderhold  Hafl 

Campus  Bo*  249 

P.  O.  Box  168 

University  of  Georgia 

University  of  Colorado 

tow *  City.  IA  52243 

Athens.  CA  30602 

Boulder.  CO  803094)249 

Dr.  Paul  W.  Holland 

Ms.  Hae-Rim  Khn 

Logjoon  Inc.  (Attn;  Library) 

Educational  Testing  Service.  21-T 

University  of  IIHnoia 

Tactical  and  Training  Systems 

Roaedale  Road 

Department  of  Statistics 

Division 

Princeton,  NJ  08541 

101  Mini  Hall 

P.O.  Bo*  85158 

725  South  Wright  Sl 

San  Diego,  CA  92138-5158 

Prof.  Lutz  F.  Homke 

Champaign,  It  61820 

Inuaut  fur  Psychologic 

Dr.  Richard  Luecht 

RWTH  Aachen 

Dr.  Jwa-kcun  Kim 

ACT 

Jaegerstrasse  17/19 

Department  of  P«ycholo©r 

P.  O.  Bo*  168 

D-5100  Aachen 

Middle  Tennessee  State 

Iowa  Gty,  IA  52243 

WEST  GERMANY 

University 

Murfreesboro,  TN  37132 

Dr.  George  B.  Maaeady 

Ms.  Julia  &  Hough 

Department  of  Measurement 

Cambridge  University  Press 

Dr.  Sung-Hoon  Kim 

Statistics  4k  Evaluation 

40  West  20th  Street 

KEDt 

Coflege  of  Education 

New  York.  NY  10011 

92-6  Umyeoo-Doog 

University  of  Maryland 

Seocho-Gu 

College  Part.  MD  20742 

Dr.  WiKam  Howefl 

Seoul 

Chief  Scientist 

SOUTH  KOREA 

Dr.  Evans  Mandea 

AFHRUCA 

George  Mason  University 

Brooks  AFB.  TX  78235-5601 

Dr.  G.  Gage  Kingsbury 

4400  University  Drive 

Portland  Public  Schools 

Fatrfa*  VA  22030 

Dr.  Huynh  Huynh 

Research  and  Evaluation  Department 

College  of  Education 

SOI  North  Dixon  Street 

Dr.  Paul  Mayberry 

Univ.  of  South  Carolina 

P.  O.  Bo*  3107 

Center  for  Naval  Analysis 

Columbia,  SC  29208 

Portland.  OR  97209-3107 

4401  Ford  Avenue 

P.O  Box  16268 

Dr.  Martin  J.  Ippd 

Dr.  WiKam  Koch 

Alexandria.  VA  22302-0268 

Center  for  the  Study  of 

Boat  7246.  Meat,  and  Evat  Or. 

Education  and  Instruction 

University  of  Texaa- Austin 

Dr.  James  R.  McBride 

Leiden  University 

Audio,  TX  78703 

HumRRO 

P.  a  Boat  9555 

6430  Elmhurst  Drive 

2300  RB  Leiden 

Dr.  James  Kraatz 

Sao  Diego.  CA  92120 

THE  NETHERLANDS 

Computer-based  Education 

Research  Laboratory 

Mr.  Christopher  McCusker 

Dr.  Robert  Jannarone 

University  of  Ihinoia 

University  of  I Know 

Elec  and  Computer  Eng.  Dept 

Urbans.  IL  61801 

Department  of  Psychology 

University  of  South  Carotins 

603  £  DanidSc 

Columbia.  SC  29208 

Dr.  Patrick  Kyfiooen 

AFHRUMOEL 

Champaign.  IL  61820 

Brook*  AFB.  TX  78235 


Ma.  Carolyn  Laoey 
ISIS  SpeaccrviHe  Rod 
Spcncervdlc,  MD  20668 


Or.  Robot  McKinley 
Educational  Testing  Service 
Princeton,  NJ  06341 


01/27/92 


Dr.  Dmd  Wiley 
School  of  Education 
and  Social  Pobey 
Northwcateni  University 
Evanston,  1L  60208 

Dr.  Brace  Wiltiaas 
Department  of  Educational 
Psychology 
University  of  Illinois 
Urbaoa,  iL  61801 


Dr.  Mark  Wilson 
School  of  Education 
University  of  California 
Berkeley.  CA  94720 

Dr.  Eugene  Winograd 
Department  of  Psychology 
Emory  University 
Atlanta,  GA  30322 

Dr.  Martin  F.  WukofT 
PERSEREC 
99  Pacific  Sl,  Suite  45S6 
Monterey,  CA  93940 

Mr.  John  R  Wolfe 

Navy  Personnel  RAD  Center 

San  Diego.  CA  92132-6800 

Dr.  Kentaro  Yamamoto 
ttWTT 

Educational  Testing  Service 
Rosedale  Road 
Princeton,  NJ  08341 

Ms.  Duani  Yan 
Educational  Testing  Service 
Princeton,  NJ  08541 

Dr.  Wendy  Yen 
CTB/McGraw  Hill 
Dd  Monte  Research  Part 
Monterey.  CA  93940 

Dr.  Joaeph  L  Young 
National  Science  Foundation 
Room  320 
1800  G  Street.  N.W. 
Washington.  DC  20550 


